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MATCHING AND RANKING 
LEGAL CITATIONS 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

5 The invention relates to retrieval of legal information by data processing systems. 

2. Background 

The essence of legal research in common law jurisdictions is the retrieval of relevant 
legal information. Within the world of the common law, cases are one of the most 
important sources of legal information. Unlike legislation, they have no official 

10 indexing or form of informational organization. Legal cases, as produced by the 
courts, generally lack defined structural elements such as titles, abstracts and 
subsections. Legal publishers and some legal electronic information vendors devote 
a great deal of resources towards the indexing, summarization and classification of 
cases and other documents. Private sector publishers often place this added 

15 information at the front of a case in the form of what has become known as a 
headnote. This permits the user to quickly ascertain whether or not the document 
is likely to be relevant. These headnotes are prepared by legally trained people, at 
a significant cost, and the publishers retain copyright in them. Without headnotes, 
a researcher may have to spend a great deal of time reading through a case in order 
20 to ascertain whether or not it is of interest. 

An ideal legal information system ought to receive queries in a very simple form that 
allows the user to specify the issues of interest and to intelligently identify documents 
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addressing the issues specified by the query. The user ought to be able to look at the 
first screen of a retrieved document and come to some conclusion as to the relevancy 
of it in regard to the search query. Returned documents ought to be ordered in 
terms of the degree of relevancy to the query. The system should be rich in relevant 
5 hypertext links. 

The law is generally found in four different kinds of documents. The law is found 
in a non-authoritative form in legal treatises. It is found in authoritative form in the 
precedents and written decisions of the courts. It is found in legislative fiats such as 
statutes, codes and regulations. And it is found in a non-authoritative form in the 
10 framework of facts and arguments which define actual litigation. 

Coinciding with these kinds of sources, one can create a profile of any legal 
document in terms of concepts, case citations, statute citations, and facts. Such a 
profile of a legal document can be used throughout an information system to form 
queries, to summarize the document, and to place hyper-text links automatically 
15 between the summaries and the full text of the document. 

A case, as a legal document, can be represented in terms of a profile of (i) the 
relevant important concepts, (ii) the citation to the leading cases on the topic, 
(iii) the relevant legislative provisions, if applicable, and (iv) the significant factual 
terms. Thus a case dealing with a felony murder where a convenience store owner 
20 dies of a heart attack shortly after a robbery could be represented by the profile 
shown in the following table. 
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CONCEPTS 
felony-murder 


CITED CASES 

People v. Cahill (1995) 22 CaI.App.4th 296 


CITED STATUTES 
Crim. Code § 187 

1 


FACTS 

convenience store 

robbery 

heart attack 



Different cases dealing with the same legal issues but different fact patterns can be 
represented by changing the significant terms of the facts quadrant. In the same way, 
the terms of the facts quadrant can remain fixed, but different concepts, case 
citations, and statutory provisions can be used to represent cases on similar facts but 
10 dealt with in terms of different legal doctrines. 

A legal text management tool that exploits this form of representation of legal 
material is FLEXICON (Fast Legal EXpert Information CONsultant), which has 
been described, for example, in the following articles, the disclosures of which are 
incorporated herein by this reference: Gelbart, D. et al., "Flexicon: An Evaluation 

15 Of A Statistical Ranking Model Adapted To Intelligent Legal Text Management", 
Proceedings of the Fourth International Conference on Artificial Intelligence and 
Law, University of British Columbia, Vancouver, Canada (1993); Gelbart, D. et al., 
"Beyond Boolean Search: FLEXICON, A Legal Text-Based Intelligent System", 
Proceedings of the Third Conference on Artificial Intelligence & Law, University of 

20 British Columbia, Vancouver, Canada, pp. 225-234 (1991); Gelbart, D. et al., "Toward 
A Comprehensive Legal Information Retrieval System", Database and Expert 
Systems Applications, Proceedings of the International Conference, Vienna, Austria, 
pp. 121-125 (1990); Gelbart, D. et al., "Current Issues in Text Retrieval: 
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FLEXICON, A Legal Text-Based Intelligent System", University of British Columbia, 
Faculty of Law Artificial Intelligence Research Project, Vancouver, Canada, pp. 1-5 
(1989); Gelbart, D. et al., "Towards Combining Automated Text Retrieval and Case- 
Based Expert Legal Advice", Law Technology Journal, CTI Law Technology Centre 
5 and Bileta, Vol. 1, No. 2, pp. 19-24 (1992); Gelbart, D. et al., "Effective Legal 
Information Retrieval Systems", Council of Canada and The Law Foundation of 
British Columbia; and Gelbart, D. et al., Tlexicon, A New Legal Information 
Retrieval System", Canadian Law Libraries, Bibliotheques de Droit Canadiennes, 
Vol. 16, No. 1, pp. 9-12 (1991). 



10 SUMMARY OF THE INVENTION 



In a system such as FLEXICON, significant preprocessing of the cases or other legal 
documents is necessary to extract the information required to fill out the documents 1 
profiles. The invention provides computer-implemented methods useful in 
automating this preprocessing. Complementary to this preprocessing, the invention 
15 also provides methods useful in ranking the results of a search where the query is 
formulated in terms of document profile categories. 



In general, in one aspect, the invention provides a method for matching a current 
case reference to a set of case references. The method includes maintaining a 
database of case references that have been processed by the method, parsing the 
20 current reference for its citations, and for each citation, parsing a citation into its 
volume, reporter, and page, and searching the database for a matching case by 
applying a set of tests to the cases in the database, the tests including: if a candidate 
case matches the current case in two volume-reporter-page citations from different 
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reporters, the candidate case is a match. In another aspect, the invention includes 
parsing the current case reference for its party names, and for each non-noise word 
in each party name, acquiring a sound-alike value for the non-noise word; and 
searching the database for a matching case by applying a set of tests including: if a 
5 candidate case matches the current case in one citation, and the cases' names match 
at least loosely, and neither case has a citation that is inconsistent with the citations 
of the other case, the candidate case is a match. 

In another aspect, the invention includes the steps of initializing a candidates set to 
be empty; adding to the candidate set a case reference from the database if it has a 
10 same party name as the current reference, by sound-alike values; adding to the 
candidate set a case reference from the database if the case reference has a volume- 
reporter-page citation matching the current citation; and searching the candidate set 
rather than the entire database of case references for a matching case by applying 
a set of tests to the cases in the candidate set. In another aspect, the method 
15 includes applying a set of tests including: if a candidate case matches the current 
case in two volume-reporter-page citations from different reporters and the court 
information for the two cases is not inconsistent, the candidate case is a match; if a 
candidate case matches the current case in two volume-reporter-page citations from 
different reporters, and the year information is not inconsistent, the candidate case 
20 is a match; and if a candidate case matches the current case in one citation and both 
the court information and the year information for the two cases is not inconsistent, 
and neither case has a citation that is inconsistent with the citations of the other case, 
the candidate case is a match. In another aspect, the invention includes applying 
tests including: if a candidate case matches the current case in one citation, and the 
25 courts and the years also match, the cases' names very tightly, and the cases have less 
than two citations that are inconsistent from one case to the other, the candidate is 
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match; and, if a candidate case matches the current case in both courts and years, the 
cases' names very tightly, and neither case has a citation that is inconsistent with the 
citations of the other case, the candidate case is match. 

In general, in another aspect, the invention provides a method for ranking the 
5 relevance of a target document found by a search query in a set of documents. The 
method includes providing a set of weighting factors defined by user for the search 
query, at least one of which weighting factors differs from the others and at least one 
of which weighting factor has a negative value; applying a metric function to the 
search query, the weighting factors, and the target document to produce a similarity 
10 measure; and ranking the target document by its similarity measure. In another 
aspect, the method includes the calculation of an inner product as part of the metric 
function. 

In general, in another aspect, the invention provides a method for ranking the 
relevance of a target document found by a search query in a set of documents, where 

15 the document terms and the search terms are each of one of the plurality of types. 
The method includes, for each type in the plurality of types, applying a metric 
function to those terms of the search query and the target document having that type, 
to produce a type-based similarity measure; combining the type-based similarity 
measures by applying a user-selectable type-based weight to each of the target 

20 document's type-based similarity measures to produce a final similarity measure; and 
ranking the target document by the final similarity measure. In another aspect, the 
method includes combining the type-based similarity measures and applying a factor 
to the similarity measures based on number of different types for which some search 
term matched the target document. In another aspect, the method includes providing 

25 a set of weighting factor for each search query, at lease one of which weighting 
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factors differs from the others, and applying a metric function to the search query, 
the weighting factors, and the target document to produce a similarity measure . 

The invention has a number of advantages. 

For example, the case matching method provides ideal case citations (case 
5 references) that improve the accuracy and usefulness of case name- and citation- 
based searches and hypertext links and that, when used with automatic case 
extraction, in affect correct extraction errors. The case matching method, by 
recognizing references to the same case, improves the usefulness of statistics that 
characterize a legal text by the frequency with which it cites cases. Similarly, the 
10 method improves the quality of statistics taken on a database of cases as a whole. 
Also, the search result ranking method improves the usefulness of search results by 
allow the user (requestor) to weigh the importance of term in a search request and 
to increase the ranking of documents that match on multiple quadrants. 

Other advantages and features will become apparent from the following description 
15 and from the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in, and constitute a part of, the 
specification, schematically illustrate specific embodiments of the invention and, 
together with the general description given above and the detailed description of the 
20 embodiments given below, serve to explain the principles of the invention. 
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FIGURE 1 is a block diagram of a data processing arrangement supporting a method 
for processing legal text. 

FIGURE 2 is a flowchart of a method for matching case references. 
FIGURES 3 is a flowchart of a method for ranking cases found in a search. 

5 DETAILED DESCRIPTION 

Turning to FIGURE 1, a preprocessor for a legal text management system is 
implemented as a computer program on a computer 10 coupled to mass data store 
12 on which are stored one or more sets of data, preferably stored in one or more 
databases managed by a database management system (not shown). Also, available 
10 for use by a user (generally human, but possibly also an application program) is a 
computer interface 18 through which search requests can be made of the data on 
data store 12, and through which information can be provided to the user. 

The preprocessor takes as input a document 14 (which may be a data file, part of a 
data file, or other form of text input) containing the text of a judicial opinion (a case) 
15 or other legal text. (For clarity of exposition, the following description is given solely 
in terms of a case; however, it will be clear that the methods described are applicable 
to the processing of other kinds of legal material.) 

Document 14 may have formatting information (such as underlining marks) in it in 
addition to plain text. Such information may be useful in preprocessing the 
20 document — for example, the names of cases cited in judicial opinions are often 
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written in italics or underlined -- but the methods described herein are intended for 
fiilly generally application and so do not rely on such non-textual information. 

The preprocessor recognizes and extracts from the text of document 14 case 
references and statute references, as will be described. A full case reference 
5 normally has a case name, which is normally formed from the names of the parties 
(e.g., "Lochner v. New York"), one or more citations, each indicating a volume 
number, reporter, and page number (e.g., "198 U.S. 45"), and a date. (The term 
"citation" is used in two senses: first, to refer to the entire reference, including the 
case name; and second, more specifically, to refer to the volume-reporter-page 
10 information. Where appropriate to avoid ambiguity, the unidiomatic terms "case 
reference" or "reference" will be used to denote the former.) 

Turning to FIGURE 2, the preprocessor parses the case name at step 210 and the 
case citation (or citations) at step 212. Cited cases (case references) are recognized 
by the preprocessor by means of template matching. Both the form of the case 

15 names ("v/'and "In re" primarily) and the form of the case citations (the familiar 
"volume, reporter, page" sequence) are matched by different template matching 
mechanisms. If a portion of text matches a case name template, the preprocessor 
searches subsequent to the name for citations to reporters. If a reporter citation is 
found first, the preceding text is examined to see if it contains a case name in a form 

20 not recognized by the general purpose case name template matcher. This process 
exploits the conventional use of capitalization. The case names are parsed into 
names of parties; and the citations are parsed into volume, reporter, page, court, and 
year, to the extent the information appears in the case reference. 



BNSDOCID: <WO 9712334A1 _l_> 



WO 97/12334 



PCT/US96/15624 



-10- 

Once a case has been found in a document, subsequent references to the case in the 
document by means of shortened forms of the case name (e.g., "... in the Smith 
case, supra, . . .")are recognized. (The preprocessor assumes that a party name from 
a previously cited case (unless it is the name of a party in the present case), when it 
5 appears in the text, is a reference to the previously cited case.) 

When a case reference has been extracted, it is added to a database 16 of case 
references, as will be described. As each new reference is added to the database, a 
check is made for a match with the references already in the database. If one is 
found, steps 216 and 218, any new information about the case from the current 

10 reference (e.g., a parallel citation to an unofficial reporter) is added to the database 
record at step 220; otherwise, a new record is made for the reference at step 222. 
(The record for a reference may be stored as a single record, in the technical 
database sense, but for purposes of this description the term should be understood 
more broadly to include any coherent set of data, stored and accessible in the 

15 database, that includes information about the case to which the case reference 
refers.) At optional step 214, a subset of the database a candidate set of cases — 
is extracted before matching is done at step 216, to include cases that match on any 
of the parts of the case reference. The extraction of a candidate set is done, in one 
embodiment, only for the sound-alike terms (which will be described), for the sake 
20 of efficiency. 

The matching of case references (step 216) against the database 16 is done with 
heuristic algorithms that rely principally on citations and secondarily on names. 
Thus, for each citation in the reference, a search may be made of the database and 
the results evaluated by the case matching filter, described below. If no match is 
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found for one citation, the next citation, if any, of the reference is considered until 
all citations have been tried. 

If no matches are found based on the reference's citation(s), the preprocessor filter 
(step 216) tries the reference's party names, as follows. A sound-alike value is 
5 created for each non-noise word of each party name using, for example, any one of 
the class of algorithms commonly known as "soundex algorithms". These associate 
a unique number (which will be called the "soundex value") with words that sound 
alike. (A frequently used example is "Smith" and "Smythe".) The database record 
for a case reference includes a soundex value for each non-noise part of each party 
10 name. The party name soundex values for the current reference are used to search 
the database. The records retrieved are sorted based on number of matches, and 
some number of the candidates from the top of the son order are tested with the 
case matching filter until either a match is found or the candidates are exhausted. 

The main module of a case matching filter is implemented in the C+ + method 
15 same case set forth in the table below, and in the routines it calls, whose functions 
are described by their names and the comments associated with them. 



/* This function returns TRUE if the two cases passed to it are the same 
and otherwise it returns FALSE. */ 

20 int case_table_type : ; same_case < f ull_case_inf o_type *x, 

case info type *y) 

{ " 

int common^cites ; 



25 



int 
int 
int 
int 
int 




inconsistent_cites ; 
al l_c ites^ma t ch ; 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



common_cites » cites_in_common (x, y, £inconsistent_cites , 

&all_cites_match) ; 

same^date = compare_dates (x , y) ; 

same_court = compare_courts (x, y) ; 

name^match - compare_names (x, y) ; 



&& same_date) 

&& name_ match >= LOOSE && inconsistent cites < 1} 



if (common_cites >= 2 && $ame_court) 

return (TRUE) 
if (comnion_cites 2 

return (TRUE) 
if (common_cites «= i 

return (TRUE) 

if (common_cites = = 1 && same_date && same^court && name_match = = 
VERY_TIGHT && inconsistent_cites < 2) ~ 
return (TRUE) ; 

if (coramon^cites == 1 && same_date && same_court && all_cites match) 
return (TRUE) ; ~~ 

if (name^match == VERY_TIGHT && same_date same_court 

inconsistent_cites < 1) 
return (TRUE) ; 

return (FALSE) ; 

} . 

/* This function compares the dates of two cases and returns TRUE if 
they are the same and FALSE otherwise. */ 

int case_table_type : : compare_dates (full_case_inf o_type *x, 

case_inf o_type *y) 

if (x->year « y->year | | y->year UNKNOWN | ! x->year -= UNKNOWN) 

return (TRUE) ; 
return (FALSE) ; 

} 

/* This function returns the number of cites the two cases passed to it 
have in common, and also returns the number of inconsistent cites the 
two cases have in common. Inconsistent cites are two different cites to 
the same reporter. If the case with the lesser number of cites all match 
cites of the other case, then all_match is TRUE, otherwise FALSE . */ 

int case_table_type : :cites_ in_common <full_case_inf o_type *x, 

case_info_type *y, int *incon_cites , int *all_match) 

int 
int 

cite_type 
int 
int 
int 

streamof f 

di sk_l ink_c i t e_ t ype 
r am_l ink_c i t e_ t ype 



common_cites * 0; 
inconsistent_cites ~ FALSE; 
x_cites [MAX_CITES] , y_cites [MAX_CITES] 
xi « 0 ; 
yi » 0 ; 
min_no_cites ; 
y_pos ; 
y_ct ; 
*rl; 



rl s & (x- >cite) ; 

while (rl »= NULL && rl->cite -valid () ) { // read x cites 
x_cites [xi] - rl->cite; 
rl = rl->next; 
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X1++ ; 

} 

x^cites [xi] . invalidate () ; 

y_pos = y->cites; // read y cites 

while (y_pos ! «* END) { 

cite_ptr_ f ile . seekg (y__pos , ios : : beg) ; 

cite_ptr_f ile >> y_ct; 

y_cites[yi] » y_ct.cite; 

y_ pos « y_ct . next_cite ; 

y_cites [yij -invalidate () ; 



min__no_cites = {xi < yi) ? xi : yi; 
if (xi 1=0 | | yi 1-0) 
15 inconsistent_cites = CITES_EXIST; 

xi - yi = 0 ; // compare cites 

while (x_cites [xi] .valid () ) { 

while <y_cites [yi] .valid () ) { 

if (x_cites [xi] y_cites [yi] ) { 
common cites++; 

} 

else if ( (x_cites [xi] . normal . unused « NO_YEAR && 
y_cites [yi] .normal .unused « NO_YEAR && x_cites [xi] . normal . reporter 



y_cites [yi] .normal . reporter) 



i i 
i i 



25 {x_cites [xi ] .normal .unused NO_YEAR && 

y_cites [yi ] .normal .unused !* NO_YEAR x_cites [xi] . normal . reporter — 
y_cites[yi] . normal . reporter) ) { 

inconsistent_cites * TRUE ; 

30 yi++; } 

yi = 0 ; 
xi++; 

35 if {x__cites [0] .valid () && y_cites [0] .valid ( ) common_cites 0) 
inconsistent__cites = NO_CITE_MATCH; 
*incon_cites = inconsistent_cites; 

if (min_no_cites > 0 && min_no_cites common_cites) 
*all match = TRUE; 

40 else 

*all_match = FALSE ; 
return (common_cites) ; 

/* This function returns TRUE if two courts are the same and FALSE 
45 otherwise. Two courts are counted as being the same if all of the 

shorter court abbreviations letters are found in the same order in the 
longer court abbreviation. Therefore 'B.C.S.C' would match with 'S.C.' 
or 'SC. */ 

int case_table_type : : compare_courts (f ull case_inf o_type *x, 

50 case info type *y) 

{ " 

char ct [MAX_COURT_LEN] ; 

char *cpl, *cp2; 
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if (y->court -« NO_COURT || x->court[0] '\0') 

return (TRUE) ; 
if (y->court *= = court - >court_number (x- >court) ) 

return (TRUE) 
5 court - > court^s t r ing ( c t , y->court); 

Cpl m Ct; 

cp2 = x->court; 

if <number_letters (cpl) > number_letters (cp2 ) ) { 
cpl ss x->court; 
10 cp2 = ct; 

while (*cpl != '\0'> { 

if (*Cp2 mm '\0') 

return (FALSE) ; 
15 if (*cpl *cp2) { 

Cpl + + ; 
Cp2+ + ; 

else { 

20 cp2++; 

while (*cpl =r= ' ' j ! +cpl == '.') 
Cpl++; 

while (*cp2 « ' ' || *cp2 '.') 
cp2-*-+ ; 

return (FALSE) ; 
} 



25 



/* This function compares names of cases. If the names are very close it 
30 returns TIGHT. If the names match somewhat it returns LOOSE, otherwise 
it returns FALSE. */ 

int case_table_type: : compare__names (full_case_xnf o_type *x, 

case_inf o_type *y) 

35 char name [MAX_CASE_LEN] ; 

s treamo f f name_p t r ; 

case_name_ptr_type name_linJc; 

int match, temp_match; 



40 



match - FALSE ; 
namejptr « y- >names ; 
do { 

name_ptr_file.seekg(name_ptr, ios : :beg) ; 
name_ ptr__f ile >> name_link; 

names_f ile . seeJcg{name_ link. case_name ptr , ios : :beg) ; 
45 names_f ile . get (name , MAX_CASE_LEN, ' \n ' ) 

if ((temp_match » namecmp (x->name, name)) I = FALSE) { 
if (temp_match > match) 

match * temp match; 

> 

name_ptr * name_link.next_case_ptr ; 
} while (name_ptr 1= END) ; 
return (match) 



50 
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/* This function compares two strings. If all words in the shorter 
string are found in the longer string in the same order, then it returns 
TIGHT. If 3 words are the same in the same order it returns LOOSE . If 
> %60 of words match it also returns LOOSE. Else it returns FALSE. */ 

5 int case_ tab 1 e_type : :namecmp (char *a, char *b) 

char nl { CAS E_NAME_LEN] , *n2 , * temp ; 

char *wl ; 
int wd_mtch = 0 ; 

10 int was = 0 ; 

int match = TIGHT; 

if (strstrifa, b) != NULL) 

return (VERYJTIGHT) ; 
if (strlen{a) < strlen(b)) { 
15 strcpy (nl, a) 

n2 = b; 

, } 
else { 

strcpy(nl, b) ; 
20 n2 * a; 

} 

wl = scrtoklnl, ■* ; : ,.-"); 
while (wl I = NULL) { 

if (words - >real_word (wl) ) { 
25 if ((temp « strstri{n2, wl) ) l« NULL) { 

wd_mtch++ ; 
n2 =* temp; 

_ _ else { 

30 match «= LOOSE; 

} 

Wds++; 

} 

wl * strtok(NULL, " ; : ,.-"); 

35 } 

if (match && wds !« 0) { 

if (match == TIGHT && wd_mtch > 1) 

return (TIGHT) ; 
if (wd_mtch >- 4 £& {( float ) wd_mtch / (float) wds > .8)) 
40 return {QUITE TIGHT); 

if (wd_mtch >- 1 \J ( (float) wd_mtch / (float)wds > .5)) 
return (LOOSE) ; 

} 

return (FALSE) ; 
45 } 



If the case matching filter finds no match (i.e., returns FALSE) for all candidate 
records, a new record is added to the database, as has been mentioned. 
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If, on the other hand, a match is found, any new information about the case from the 
current reference (e.g., a parallel citation to an unofficial reporter) is added to the 
record in the database 16 for the case reference. When information is added in this 
way to a case in the database, this newly extended case record is used as the search 
5 case for another search of the database, steps 224 and 226, using the same matching 
filter described above. If exactly one matching case is found, the current case record 
is merged with the matching case record, step 228; if more than one matching case 
is found, all matching cases are merged into one record in the database. 

The database 16 so generated can be further processed to generate "ideal" case 
10 references that can be used in processing search queries, building hypertext links, and 
so on. Each case record in the database includes all variants of the case name that 
have been encountered and a use count for each variant. In one embodiment, the 
variant that appears most frequently is chosen as the ideal case name. In alternative 
embodiments, the ideal case name must also meet other criteria, such a having a 
15 particular form, such as "A v. B\ or "In re C\ The ideal citation form for a 
reference will be, in one embodiment, a standard form, such as a "blue book" or 
California Style Manual. In another embodiment, all known parallel citations are 
included in the ideal citation. This allows the preprocessor to provide alternate 
citations to a cited case even if such citations are not present in the case being 
20 viewed, if the alternate citation appears somewhere in the database of cases. In 
addition, in this process the form of case citations are corrected by the preprocessor 
so that they accord with generally accepted citations rules. 

Statute citations are recognized by the preprocessor through template matching. The 
templates are largely based on conventional citation formats for the various statutes. 
25 Thus, unconventional methods of citing statutes by individual judges may affect the 
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accuracy of statutes extraction. A certain range of formats can be tolerated as 
different templates can be set up to deal with discrepancies in the format of citations 
to statutes. Citations in an unconventional format are converted to the appropriate 
generally-accepted format. 

5 The use of matching templates relies to some degree on a knowledge of the 
jurisdiction of the case. For example, a reference to the "Evidence Code" in a 
California case means a different thing than identical reference in a New York case. 
These problems are taken care of by matching some templates only if the case 
belongs to certain jurisdictions. Also, matching can occur based on the use of a word 
10 such as " Act" or "Code" in the case (as in "Copyright Act" or "Bankruptcy Code"). 

References to sections (and subsections) of statutes are also identified by template 
matching. These references are associated with a statute primarily on the basis of 
the proximity of the section reference in the text to a reference to a statute. 

Legal concepts are automatically extracted from text by matching sections of the text 
15 with terms contained in a legal concept dictionary, which is constructed by hand. 
The dictionary is a domain lexicon of words or phrases used by legal professionals. 
Each term in the dictionary consists of the stems of one or more words, which are 
matched to the text, and a legal concept, to which the stem is linked. Most concept 
phrases in the dictionary are associated with more than one stem, thus allowing users 
20 to retrieve documents containing terms that are synonymous or semantically similar 
to concept phrases selected as search terms by the user. The dictionary also 
distinguishes between entries that require an exact match versus entries that allow 
the matched information to appear in the text in any order, to be suffixed, or to be 
separated by noise words. 
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Concepts represent ideas. A legal concept generally gets its meaning from its 
relationship to a set of concepts which together constitute a legal doctrine or a 
procedural practice. Whether or not a word or phrase is, or represents, a legal 
concept ought to be measured in terms of its relationship to a particular doctrinal 
5 structure or sets of structures. For example "confession" is a legal concept because 
it has a semantic relationship to a doctrinal structure about responsibility and 
evidence, which in turn is part of a doctrinal sub-set of criminal law. 

Since almost any kind of idea constitutes a concept of some kind or other, no sharp 
distinction can be drawn between the legal sub-language and the language of natural 

10 discourse. Some of the concepts of legal discourse are highly technical and unique 
to law, others have a great deal to do with the law, but are widely used in general 
discourse. Still other concepts are non-legal but are, in fact, extensively used in the 
discourse of law. The goal in constructing a concept dictionary is to include in it only 
concepts that function as signifiers in that they are generally correlated with factual 

15 concepts that function as the signified. 

The legal concept dictionary is constructed from a wide variety of legal sources such 
as legal dictionaries, thesauri, statutes, indexes, learned authorities, and treatises. 
The dictionary includes synonym information and allows (when applicable) the 
matched information to appear in the text in any order, to be suffixed, and to have 
20 the words in the concept phrase separated by noise words. 

As has been mentioned, a typical case contains a factual story, a description of the 
set of legal issues which the story gives rise to, a statement of the applicable law, and 
a resolution of the issues when the law has been applied to the facts. After the 
removal of legal concepts that are recognized by the legal concept dictionary, and of 
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case and statute citations that are recognized by template matching functions, the 
remaining text represents the facts of the case. Single word fact terms can be 
generated by removing noise words as determined by a noise word list. However, an 
improved indexing and query representation can be achieved by incorporating multi- 
5 word fact terms in both document and qufcry representations. Unlike the recognition 
of legal concept phrases, which is dictionary based, the recognition of fact phrases is 
based on automatic sentence construct analysis. The underlying technology is 
described in the following references, whose disclosures are included here by this 
reference: Dillon, M. and Gray, S.,FASIT: A Fully Automatic Syntactically Based 
10 Indexing System, Journal of the American Society of Information Science 34 (1983); 
Fagan, J., Experiments in Automatic Phrase Indexing for Document Retrieval: A 
Comparison of Syntactic and Non-Syntactic Methods, Ph.D. Thesis, Technical Report 
87-868, Cornell University, Computer Science Department (1987); Smeaton, A., 
Information Retrieval Research: How It Might Affect the Practicing Lawyer, in S. 
15 Nagel, ed., Law, Decision-making and Micro Computers (1991); and Croft, W.B., 
Turtles, H.R., and Lewis, D.D., The use of Phrases and Structured Queries in 
Information Retrieval, in Proceedings of the ACM SIGIR Conference on Research and 
Development in Information Retrieval (1991). 

The preprocessor recognizes multi-word fact phrases by combining term distribution 
20 and proximity information with a lexicon of noise words. It defines categories of 
noise words and uses them as "glue" connecting fact terms into phrases. "Joiners" 
(e.g., "by Vor)join two fact terms; "modifiers" (e.g., "extended", "civil") qualify or 
constrain terms; and "pure noise" is eliminated. The preprocessor also uses a set of 
rules to identify classes of noise terms such as names and numbers that are retained 
25 in the context of citations. While this simple approach to phrase recognition can 
result in some meaningless, useless terms, or over-specific terms, their occurrence is 
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minimized by the use of corpus filtering; i.e., the elimination of terms whose 
collection frequency falls below a given threshold and by applying constraints on the 
length of automatically determined terms. 

Returning to FIGURE 1, with the concepts, case references, statutes, and facts 
5 extracted from a database of cases 15 — e.g., one representing a body of case law - 
the database of cases 15 can be searched with a query having terms of one or more 
types or categories (i.e., from one or more of the profile quadrants). The search and 
retrieval model that will be described is an adaptation of the vector space model, 
described in Salton, G., and McGill, MJ M Introduction to Modern Information 
10 Retrieval (1983), the disclosure of which is incorporated by this reference. 



Turning to FIGURE 3, the retrieval model represents both documents and 
queries, step 3 10 , as lists of weighted words and phrases. Relevant documents are 
retrieved by comparing a query composed of keyword terms of one or more types to 
document profiles stored in a database. At step 312, the candidate list of documents 
15 against which the query is tested is made up of those documents in which any of the 
search terms are found. (If the NOT modifier is used, the terms it modifies are not 
included in making the initial selection.) 

At step 314, the similarity between a document and query is calculated with a metric 
based on the cosine formula, which is described in Salton, G. t Automatic Text 
20 Processing, Addison- Wesley, 1989. The cosine formula measures the extent of a 
match between the document and query and produces a similarity score with respect 
to a document j t taking a normalized inner product between a query vector and a 
document vector, as follows, 
where 
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SlTUj = 



1=1 



N 



i- 1 



M 



(i) 



i-i 



sirrij = 



9, 



the calculated similarity of a query to a particular 
document j 

the number of terms in database 

the user assigned weight for term / 

the weight of term / in document j (this is a vector in / 

only) 



and where 



where 



10 



N 
n, 



d ij = Aj * lo 8 



(2) 



the number of times term i appears in document j 
the total number of documents in the collection 
the number of documents contain term / 



This formula can be expressed more succinctly using conventional vector notation, 
where 

Q = the vector of values ^, 
15 Dj = the vector of values d tJ 

by which the similarity measure set forth above can be expressed (step 322) as 
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(3) 



l<?l x IDji 



The vector space method and cosine formula were developed to measure the 
similarity of one document to other documents in a collection. The values q„ in that 



document that serves as a query. In the present method, the values q k have a default 
5 value of 1, but are user selectable to other values. User interface categories of 
High, Medium, Low, and Not simplify the user's task in selecting these values and 
are translated into the numeric values q } used in the similarity calculation. The Not 
category actually represents a negative number, resulting in documents that contain 
the term to have a lower score than they would otherwise. Thus, the retrieval model 
10 allows the user to identify the importance of a term. 

The retrieval model differs from the basic cosine formula (1), above, in other 
respects as well. The document weight factor is normally calculated in the retrieval 
model using the square root of the frequency factor, as follows, rather than formula 
(2), above. 



15 Also, at optional steps 320 and 324, the model provides for a quadrant-based 
weighting factor k h . (The subscript h selects one of the four types, just as the 
subscript / selected one of the terms in the database.) Thus, with quadrant-based 
weighting the similarity is measured by the type of the query term (that is, in the 
four-quadrant profile set forth above, by whether the query term is one of concept, 

20 case, statute, or fact), and the similarity for each type is weighted by the factor k h . 
This is expressed (steps 322 and 324) in the following formula, 



context, were proportional to the number of times the i-th term appears in the 




(4) 
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-J £ (5) 

' h iQJ x SD yft || 

where the subscript h indicates that the vectors Q k and D jh are limited to the terms 
in the respective quadrants. 

Alternatively, the normalization is done on the document as a whole, thus. 

sim = -i (6) 

7 k?i x bd;i 



(This is an example of normalization step 326.) Also, the retrieval model provides 
5 for the weighting of the similarity score by a user-selectable factor, step 328. The 
alternatives are (a) the factor 1 , (b) the number of quadrants in which a match was 
found, (c) the square root of the number of quadrants in which a match was found, 
and (d) the ratio of the number of terms in the query found in document j divided 
by the total number of terms in the query. Alternative (d) scales the similarity score 
10 to the ratio of the total number of query terms found to the total number of query 
terms. Use of this alternative (d) is the default configuration. This emphasizes 
documents that have many matching terms over documents that have one term 
matching many times. Alternative (d) may be used in combination with either 
alternative (b) or (c). 

15 The model also allows the user to scale the similarity score on a quadrant (type) 
basis with a factor that is the number of terms of the type (i.e., in the quadrant) in 
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the query found in document j divided by the total number of terms of the type in 
the query. 

As can be seen, the retrieval model allows the user to weigh document search terms 
to reduce the importance of common words in a search while maintaining the 
5 importance of multiple hits within a document. By using the length of the query and 
the length of the document (measured by the number of terms that occur in each) 
to normalize the score, queries or documents that are particularly verbose do not 
tend to swamp the results. 

The present invention has been described in terms of specific embodiments. The 
10 invention, however, is not limited to these specific embodiments. Rather, the scope 
of the invention is defined by the following claims* and other embodiments are within 
the scope of the claims. For example, the metric for ranking need not be the cosine 
formula, or a formula derived from the cosine formula. Other metrics, including a 
probabilistic metric, such as, for example, a Bayesian belief network, can also be 
15 used. 
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CLAIMS 

What is claimed is: 

1. A method for matching a current case reference to a set of case references, 
comprising: 

5 (a) maintaining a database of the case references that have been processed by 

the method; 

(b) parsing the current reference for its citations and, for each citation (the 
current citation) in the current reference, parsing the current citation into 
its volume, reporter, and page; 
10 (c) searching the database of the case references for a matching case by 

applying a set of tests to the cases in the database of the case references, 
the set of tests including: 

(A) if a candidate case matches the current case in two volume- 
reporter-page citations from different reporters, the candidate 
15 case is a match. 

2. The method of claim 1, further comprising: 

(d) parsing the current reference for its party names and, for each non-noise 
word in each party name in the current reference, acquiring a sound-alike 
value for the non-noise word; 
20 (e) searching the database of the case references for a matching case by 

applying a set of tests to the cases in the database of the case references, 
the set of tests including: 

(A) if a candidate case matches the current case in one citation, and 
the cases' names match at least loosely, and neither case has a 
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citation that is inconsistent with the citations of the other case, 
the candidate case is a match. 

3. The method of claim 2, further comprising: 
(f) initializing a candidate set to be empty; 
5 (g) adding to the candidate set a case reference from the database if it has a 

same party name as the current reference, by sound-alike values; 
(h) adding to the candidate set a case reference from the database if the case 
reference has a volume-reporter-page citation matching the current 
citation; 

10 (0 searching the candidate set rather than the entire database of case 

references for a matching case by applying a set of tests to the cases in the 
candidate set. 

"4. A method for matching a current case reference to a set of case references, 
comprising: 

15 (a) maintaining a database of the case references that have been processed by 

the method; 

(b) initializing a candidate set to be empty; 

(c) parsing the current reference for its citations and, for each citation (the 
current citation) in the current reference, 

(1) parsing the current citation into its volume, reporter, page, court, and 
year, and then 

(2) adding to the candidate list a case reference from the database if the 
case reference has a volume-reporter-page citation matching the 
current citation; 



20 
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(d) searching the candidate list for a matching case by applying a set of tests 
to the cases in the candidate list, the set of tests including a test selected 
from the group consisting of: 

(A) if a candidate case matches the current case in two volume- 
5 reporter-page citations from different reporters, and the court 

information for the two cases is not inconsistent, the candidate 
case is a match, 

(B) if a candidate case matches the current case in two volume- 
reporter-page citations from different reporters, and the year 

10 information is not inconsistent, the candidate case is a match, 

and 

(C) if a candidate case matches the current case in one citation, and 
both the court information and the year information for the two 
cases is not inconsistent, and neither case has a citation that is 

15 inconsistent with the citations of the other case, the candidate 

case is a match. 

5. The method of claim 4, further comprising: 

(e) parsing the current reference for its party names and, for each non-noise 
word in each party name in the current reference, acquiring a sound-alike 
20 value for the non-noise word; 

(0 adding to the candidate set a case reference from the database if it has a 

same party name as the current reference, by sound-alike values; 
(g) searching the candidate set for a matching case by applying a set of tests 
to the cases in the candidate set, the set of tests including a test selected 
25 from the group consisting of: 
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( A) if a candidate case matches the current case in one citation, and 
the cases' names match at least loosely, and neither case has a 
citation that is inconsistent with the citations of the other case, 
the candidate case is a match; 

(B) if a candidate case matches the current case in one citation, and 
the courts and the years also match, the cases' names match very 
tightly, and the cases have less than two citations that are 
inconsistent from one case to the other, the candidate case is a 
match; and 

(C) if a candidate case matches the current case in both courts and 
the years, the cases' names match very tightly, and neither case 
has a citation that is inconsistent with the citations- of the other 
case, the candidate case is a match. 

A method for ranking the relevance of a target document found by a search 
query in a set of documents, where the query has search terms, the method 
comprising: 

(a) providing a set of weighting factors defined by a user for the search query, 
at least one of which weighting factors differing from the other weighting 
factors in the set of weighting factors and at least one weighting factor 
having a negative value, whereby each search term has an associated 
weighting factor; 

(b) applying a metric function to the search query, the weighting factors, and 
the target document to produce a similarity measure for the target 
document against the search query weighted by the weighting factors; and 

(c) ranking the target document by its similarity measure. 
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The method of claim 6 wherein the metric function includes a calculation of an 
inner product between a search query and the documents in the set over a 
document term vector space. 

A method for ranking the relevance of a target document found by a search 
query in a set of documents, where the documents in the set of documents have 
document terms, each document term being of one of a plurality of types, and 
where the search query has search terms, each search term being of one of the 
plurality of types, the method comprising: 

(a) for each type in the plurality of types, applying a metric function to those 
terms of the search query and the target document having the type, to 
produce a type-based similarity measure for the target document against 
the search query for each type in the plurality of types; 

(b) combining the type-based similarity measures by applying a user-selectable 
type-based weight to each of the target document's type-based similarity 
measures to produce a final similarity measure; and 

(c) ranking the target document by the final similarity measure. 

A method for ranking the relevance of a target document found by a search 
query in a set of documents, where the documents in the set of documents have 
document terms, each document term being of one of a plurality of types, and 
where the search query has search terms, each search term being of one of the 
plurality of types, the method comprising: 

(a) for each type in the plurality of types, applying a metric function to those 
terms of the search query and the target document having the type, to 
produce a type-based similarity measure for the target document against 
the search query for each type in the plurality of types; 
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(b) combining the type-based similarity measures and applying a factor to the 
similarity measures based on the number of different types for which some 
search term matched a target document to produce a final similarity 
measure; and 

5 (c) ranking the target document by the final similarity measure. 



10. The method of claim 9 further comprising: 

providing a set of weighting factors for the search query, at least one of which 
weighting factors differs from the other weighting factors in the set of 
weighting factors, whereby each search term has an associated weighting 
10 factor; and wherein 

the step of applying a metric function further comprises applying a metric 
function to the search query, the weighting factors, and the target 
document to produce a similarity measure for the target document against 
the search query weighted by the weighting factors. 



15 11. The method of claim 10 wherein the metric function includes a calculation of 
an inner product between a search query and the documents in the set over a 
document term vector space. 

12. The method of claim 10 wherein the step of providing a set of weighting factors 
comprises providing a set of weighting factors defined by a user for the search 

20 query. 

13. The method of claim 12 wherein the step of providing a set of weighting factors 
comprises providing at least one weighting factor having a negative value. 



BNSDOCID: <WO 9712334A1_I_> 



WO 97/12334 PCT/US96/1S624 

1/3 

FIG. 1 




BNSDOCID: <WO_ 



_9712334A1_i_: 



WO 97/12334 



2/3 



PCT/US96/15624 



FIG. 2 



PARSE 
CASE 
NAME 

210 



PARSE 
CASE 
CITATION 
212 



DEFINE 
CANDIDATE 

SET OF 
DATABASE 

CASES 
Z1A 



MATCH 
CASE TO 
DATABASE 
WITH 
FILTER 
213. 



ADD ANY 
NEW INFO 
FROM 
REFERENCE 

TO 
DATABASE 
RECORD 
220 



• YES 




NO-* 



ADD TO 
DATABASE 
222 



MATCH 
ENLARGED 
RECORD TO 
REST OF 
DATABASE 
WITH 
FILTER 
224 




YES 



MERGE 
RECORDS 
228 



BNSDOCID: <WO_ 



_9712334A1 J_> 



WO 97/12334 



3/3 



PCT/US96/15624 



FIG. 3 



314 



GET 
WEIGHT 
FOR EACH 
SEARCH 
TERM 
310 



ADD TO SET 

OF 
CANDIDATE 
DOCUMENTS 

THOSE 
CONTAINING 
THE 
POSITIVE- 
WEIGHTED 
TERMS 
312 



FOR EACH 
CANDIDATE 
DOCUMENT, 
CALCULATE 
SIMILARITY 
METRIC 
3JL4 



RANK 
DOCUMENTS 
ON THE 
METRIC 
316 



DIVIDE 
SEARCH AND 
DOCUMENT 
TERMS INTO 
TYPES 
220. 



CALCULATE 

INNER 
PRODUCT(S) 
OF SEARCH 

WEIGHT 
VECTOR AND 
DOCUMENT 
VECTOR 
322 



I 



SCALE THE 

INNER 
PRODUCT(S) 
324 



I 



NORMALIZE 
THE INNER 
PRODUCT(S) 
326 



SCALE 
RESULT 
22& 



BNSDOCID: <WO_ 



_9712334A1J_> 



INTERNATIONAL SEARCH REPORT 



Internationa! application No. 
PCT/US967 15624 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :G06F 17/30, 17/27; G11C 13/04 

US CL :395/600; 364/419.19; 364.252,1 
According to International Patent Classification (IPC) or to both national classifi cation and IPC 



FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 395/600; 364/419.19; 364.252.1 



Documentation searched other than minimum documentation to the extent ihat such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS, EIC, Law Library, DIALOG, DfVLINK 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5,321 ,833 A (CHANG ETAL) 14 JUNE 1994 (29/08/90), 
see entire document. 

US 5,157,783 A (ANDERSON ET AL) 20 October 1992 
(26/06/88), see entire document, especially Figs. 4, 7 9-17 
cols. 1, 27-32. 

US 5,278,980 A (PEDERSEN ET AL) 11 January 1994 
(16/08/91), see cols. 1-12. 

COHEN et al. Finding the Law, An Abridged Edition of How 
to Find the Law, 9th ed. Minnesota: West Publishing. 1989 

JOHNSON-MALONEY et al. WESTLAW Reference Manual, 
5th Edition. Minnesota: West Publishing. 1993, sections 4 7 
7, 10, 14, and 16. 



6-13 



1-5 



1-5 



1-5 



1-5 



Further documents are listed in the continuation of Box C | ] See patent family annex. 



Special categoric* of cited documents: 

document dcTuunj the general state of tbe ait which is not consideiwd 
to be of particular relevance 

earlier document published on or after tbe international filing date 

document which may throw doubts on priority claim(s) or which m 
ritad to rtah lis h the publication dale of another citation or other 
special ream (as specified) *Y' 

document referrm* to an oral disclosure, use, exhibition or other 

the interuationaJ filing date but later than •*,> 
the priority dale claimed 



later document published after the 

date and not in coo/bct with tbe application 
principle or theory underlying the av 



filing date or priority 
but cited to understand the 



documeat of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document is taken akmc 

document of particular relevance: the claimed invention cannot be 
considered lo involve an Lwenuve step when the document is 
co m hiD rri with one or more other such documents, such combmation 
beinc obvious to a person skilled in the art 

document member of tbe same patent family 



Date of the actual completion of the international search 
31 OCTOBER 1996 



Date of mailing of 



report 



Name and mailing address of the ISA/US 
Commissioner of Patent* and Trade marts 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 



AuuW^eH^icer// 

^Charles rones 

Telephone No. (703) 306-3030 



BNSDOCID: <WO 



G712334A1_I_> 



?cond sheet)(July 1992)* 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US96/ 15624 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category - 



Y, P 
X, P 



Citation of document, with indication, where appropriate, of the relevant passages 



US 5,265,065 A (TURTLE) 23 November 1993 (08/10/91), see 
entire document. 

US 4,823,306 A (BARBIC ET AL) 18 April 1989 (14/08/87), see 
entire document, expecially Figs, la-b, cols. 1-8. 

US 5,537,586 A (AMRAM ET AL) 16 July 1996 (30/04/92), see 
entire document, especially Figs. 3-11, 14-15, col. 1-12. 

US 5,544,352 A (EGGER) 06 August 1996 (14/06/93), see entire 
document, especially Figs. 4H-I, 5B-H, cols. 1-7 and 11-30. 

ROSE et.al. Legal Information Retrieval: A Hybrid Approach, 
International Conference on Artificial Intelligence and Law. 
Canada: ACM Press. 13 June 1989, see pages 138-146. 

GELBART et al. Beyond Boolean Search: FLEXICON, A Legal 
Text-Based Intelligence System. England: ACM Press. 25 June 
1991, see pages 225-234. 



Relevant to claim No. 



6-13 



6-13 



6-13 



1-13 



1-5 



1-6 



Form PCT/1SA/210 (continuation of second sheet )(July 1992)* 



BNSDOCID: tWO_ 



_S712334A1_I_ 



INTERNATIONAL SEARCH REPORT 


International application No. 




PCT/US96/15624 



Box I Observations where certain claims were found unsearchable {Continuation of kern 1 of first sheet) 



This international report has not been established in respect of certain claims under Article 17(2Xa) for the following reasons: 
Claims Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely: 



Claims Nos.: 

because they relate to parts of the international application that do not comply with the prescribed requirements to such 
an extent that no meaningful international search can be carried out, specifically: 



Claims Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 6.4(a). 



Box II Observations where unity of invention is lacking (Continuation of item 2 of first sheet) 



This International Searching Authority found multiple inventions in this international application, as follows: 
Please See Extra Sheet. 



As all required additional search fees were timely paid by the applicant, this international search report covers all searchable 
claims. 

As all searchable claims could be searched without effort justifying an additional fee, this Authority did not invke payment 
of any additional fee. 

As only some of the required additional search fees were timely paid by the applicant, this international search report covers 
only those claims for which fees were paid, specifically claims Nos.: 



No required additional search fees were timely paid by the applicant. Consequently, this international search report is 
reatricted to the invention first mentioned in the claims; it is covered by claims Nos . : 



Remark on Protest [ | The additional search fees were accompanied by the applicant's protest. 




No protest accompanied the payment of additional search fees. 



2 □ 
*• □ 



1 0 
□ 



* □ 



Form PCT/IS A/210 (continuation of first sheet(l))(July 1992)* 

BNSDOCID: <WO 97 1 2334A 1 _t_> 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCTAJS96/15624 



BOX II. OBSERVATIONS WHERE UNITY OF INVENTION WAS LACKING 
This ISA found multiple inventions as follows: 

I. Claims 1-5 , class (364/400-401), drawn to a specific method related to matching legal citations. 

II. Claims 6-13, classes 395/(600,419.19), drawn to a method related to ranking and ordering various documents. 



The species listed above do not relate to a single inventive concept under PCT Rule 13.1 because, under PCT Rule 
13.2, the species lack the same or corresponding special technical features for the following reasons: Group 1 is related 
to matching of legal citations in databases, whereas Group II is related to ranking and ordering the similarity of 
documents. 

The matching of legal citations as per group I employs a different technique (special technical feature) then that 
employed to rank and order the similarity of documents in that the group I claims include the parsing of a case 
reference for its citations and performing a search for an appropriate match, whereas group II provides weighting 
factors defined by the use of a search query and applies a metric function to the search query, the weighting factors and 
the target document. 



Form PCT/ISA/2I0 (extra sheet)(July 1992)* 

BNSDOCID: <WO 9712334A1_I„> 



